Front Propagation with Rejuvenation in Flipping Processes 
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We study a directed flipping process that underlies the performance of the random edge simplex 
algorithm. In this stochastic process, which takes place on a one-dimensional lattice whose sites may 
be either occupied or vacant, occupied sites become vacant at a constant rate and simultaneously 
cause all sites to the right to change their state. This random process exhibits rich phenomenology. 
First, there is a front, defined by the position of the left-most occupied site, that propagates at a 
nontrivial velocity. Second, the front involves a depletion zone with an excess of vacant sites. The 
total excess A^ increases logarithmically, A^ ~ In k, with the distance k from the front. Third, the 
front exhibits rejuvenation — young fronts are vigorous but old fronts are sluggish. We investigate 
these phenomena using a quasi-static approximation, direct solutions of small systems, and numerical 
simulations. 

PACS numbers: 02.50.-r, 05.40.-a, 05.70.Ln, 89.20.Ff 



I. INTRODUCTION 

The simplex algorithm [l| is the fastest general algo- 
rithm for solving linear problems. While efficient in the 
typical case, the deterministic simplex algorithm requires 
an exponential time in the worst cases Randomized 
versions of the simplex algorithm have an improved run- 
ning time that is quadratic in the number of inequalities. 
The performance of the random edge simplex algorithm 
on Klee-Minty cubes ultimately reduces to a simple 
asymmetric flipping process in one dimension Q • In this 
process, an infinite sequence of and 1 bits evolves by 
flipping randomly chosen 1 bits and simultaneously flip- 
ping all bits to the right. Figure Q] illustrates how the 
underlined bit flips all bits to the right. When flips oc- 
cur at a constant and spatially uniform rate, the position 
of the left-most 1 bit moves to the right at a constant 
average velocity. Previous formal studies were primar- 
ily concerned with establishing the ballistic front motion 
rigorously Q, yet most of the questions concerning the 
flipping process, including the propagation velocity, re- 
main largely unanswered. 
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FIG. 1: Illustration of the flipping process. The arrow indi- 
cates the direction of time and the line indicates the position 
of the advancing front. 

We approach this random process as a nonequilibrium 
dynamics problem and by utilizing a host of theoretical 
and computational methods, we find that this directed 
flipping process exhibits interesting phenomenology be- 



yond the ballistic front propagation. We also propose 
a modified process where front propagation is forbidden 
and show that this process, for which further theoretical 
analysis is possible, provides an excellent quantitative de- 
scription. 

Our starting point is a quasi-static approximation. In 
this description, the shape of the propagating front is as- 
sumed to be fixed and additionally, spatial correlations 
are ignored. This approximation yields a qualitative de- 
scription for the overall shape of the front and an ex- 
act description for the shape far away from the front. 
The propagating front consists of a depletion zone as the 
number of bits exceeds the number of 1 bits, and the 
cumulative depletion grows logarithmically with distance 
from the front. 

Direct numerical simulations of the flipping process re- 
veal that spatial and temporal correlations are substan- 
tial. In general, neighboring bits are correlated as man- 
ifested by the increased likelihood of finding consecutive 
strings of identical bits. There are also aging and rejuve- 
nation. The state of the system strongly depends on age, 
defined as the time elapsed since the most recent front 
advancement event. In particular, young fronts are more 
rapid than old front. 

We also develop a formal solution method that de- 
scribes the evolution of a finite segment that includes 
the front. In this approach, the time evolution of all mi- 
croscopic configurations of a finite segment is described 
under the assumption that the system is completely ran- 
dom outside the segment. The predictions improve sys- 
tematically as the segment size increases but there is a 
limitation since the number of configurations grows ex- 
ponentially with segment size. Nevertheless, we are able 
to obtain accurate estimates for quantities of interest in- 
cluding the propagation velocity by using Shanks extrap- 
olation. 

In the directed flipping process, the system does not 



reach a steady state because of the perpetual motion of 
the front, yet when the front is pinned, the system does 
settle into a steady state. We therefore also examined 
a modified process in which the flipping of the leftmost 
bit is forbidden. Remarkably, this pinned front process 
provides an excellent quantitative approximation of the 
original propagating front process. In this case, we are 
able to obtain several exact results. For example, we can 
show that a pair of neighboring sites is correlated. More- 
over, the small system solution is now exact and com- 
bined with the Shanks transformation, yields excellent 
results for the velocity. 

The rest of this paper is organized as follows. In section 
II, titled "propagating fronts" , we investigate the original 
flipping process. We begin with a quasi-static approxi- 
mation for the shape of the front, continue with numer- 
ical simulations that elucidate spatial and temporal cor- 
relations, and finish with analysis of small segments. In 
section III, titled "pinned fronts" , we examine the corre- 
sponding behaviors in a modified flipping process where 
the front is pinned and hence further theoretical analysis 
is possible. Conclusions are presented in section IV. 



II. PROPAGATING FRONTS 

The flipping process takes place on an infinite one- 
dimensional lattice whose sites may be in one of two 
states. If <7j denotes the state of ith site then <7j = 1 
corresponds to an occupied site, a 1-bit, and <jj = cor- 
responds to a vacant site, a 0-bit. In the flipping process, 
each occupied site may "flip" from the occupied state to 
the vacant state and consequently cause all sites to the 
right to simultaneously change their state. For example, 
when the jth site flips, 



0", 



1 — <7j, for all i > j. 



(1) 



The flipping process is uniform: all occupied sites flip 
at a uniform rate, set to one without loss of generality. 
Note that the interaction range is infinite: every flip event 
affects an infinite number of sites! This is in contrast, for 
example, with constrained spin dynamics such as the east 
model pi, 0, H[ where the flipping is caused only by the 
neighboring spin on the left. 

Vacant sites with no occupied sites to their left remain 
vacant forever. Moreover, the left-most occupied site de- 
fines a front that advances to the right, as shown in fig- 
ure 1. We consider the natural initial condition where all 
sites left of the origin are vacant, <7j(i = 0) = for all 
i < 0, the origin is occupied <j (t = 0) = 1, and all sites 
right of the origin are randomly occupied: with equal 
probabilities ai(t = 0) = 1 or &i(t = 0) = for all i > 0. 



A. Front Profile and Depletion 

We index the system using a reference frame that is 
moving with the front. Specifically, we characterize lat- 




FIG. 2: The density profile pk, obtained from the quasi-static 
approximation. 



tice sites by their distance k from the front, and by defi- 
nition, (To — 1- The profile of the advancing front is best 
described by the density Pk{t), the average occupation at 
distance k from the front at time t, Pk(t) = (<7fc(t)), where 
the brackets indicate an average over all realizations of 
the random process. 

Our theoretical description involves two simplifying as- 
sumptions. If we overlook the motion of the front, the 
densities satisfy 



d(<Jk) 
dt 




.i=o 



for k > 0. The gain term on the right-hand size ac- 
counts for vacant sites changing into occupied sites and 
conversely, the loss term represents occupied sites chang- 
ing into vacant sites. Since every occupied site to the left 
can cause a vacant site to change, the gain rate at the 
kth site equals the total number of occupied sites to the 
left. The loss rate, however, is larger by one because a 
flip at the site itself can also cause an occupied site to 
change. 

The evolution equations ([2]) are hierarchical: the equa- 
tion for one-site averages involves two-sites averages, the 
equation for two-site averages involves three-site aver- 
ages, etc. If we ignore possible correlations between dif- 
ferent sites and approximate two-site averages by the 
product of the respective single site averages {<Jj<Jk) — * 
(crj)(ak), the densities satisfy the closed equation 



' k-l 



(1 - Pk) ~ 




(3) 



The flipping rates in equations ©-© reflect the fact that 
occupied sites change at a higher rate than vacant sites. 

Our final assumption is that in the reference frame 
moving with the front, the system is quasi-static. In- 
deed, by definition dpo/dt — 0, and we further assume 




dpk/dt = for all k. The stationary density profile is 



Pk 



Lj=o Pi 



1 



(4) 



This recursive equation is solved subject to the boundary 
condition po = 1. For small k we have 



pk 



f, 
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fc = 0,l,2,3, 



(5) 



Despite the crude simplifying assumptions, this quasi- 
static approximation provides the following valuable in- 
sights (see figured]): 

1. Depletion. With the exception of the occupied 
front, all sites are more likely to be vacant, pk < 1/2 
for all k > 0. In other words, the propagating front 
includes a depletion zone. This depletion is a direct 
consequence of the fact that occupied sites change 
at a higher rate than vacant sites. In other words, 
vacant sites have a larger lifetime. 

2. Monotonicity. The density profile is monotonic, 
Pi > pj for i > j > 1. 

The tail of the density profile can be obtained by not- 
ing that pk — > 1/2 as follows from ((3]). Consequently, 
the average total "mass" to the left of a given site, 
m k = Sj=o Pj-> g rows linearly with distance, ~ k/2. 
At large distances, the recursion equation for the density 
Pk = mk/(2mk + 1) can be re-written as pk — ■ 
and therefore, 



l 

4m k 



Pk 



1 

2k' 



(6) 



Far away from the front, sites are occupied at random as 
Pk — ¥ 1/2 for k — > oo. Indeed, sites at the tail change 
their state extremely rapidly at rates that grow linearly 
with distance. These rapid changes effectively destroy 



spatial correlations. Moreover, the advancement of the 
front becomes irrelevant at large distances. Hence, the 
two assumptions underlying our theory are inconsequen- 
tial in the tail region and © is in fact exact. We com- 
ment that the algebraic tail ((6]) is unusual because travel- 
in g wa ves are typically characterized by exponential tails 

The cumulative expected excess of vacant sites over oc- 
cupied sites, Afc = 52j-_o(l — 2pj), measures the extent 
of the depletion zone. This quantity follows from the tail 
behavior ([5]), Aj. = k — 2mk, and since mj. ~ (k — lnfc)/2, 
the excess of vacant sites grows logarithmically with dis- 
tance, 



In k. 



(7) 



Thus, the total excess of vacant sites is divergent! 

We confirmed the theoretical predictions for the alge- 
braic tail (JHJ) and the logarithmic growth of the excess ([7]) 
using massive Monte Carlo simulations (figure 2). The 
numerical simulations are straightforward. In each sim- 
ulation step one site is chosen at random. If this site is 
occupied, the state of the site and all sites to the right 
change according to ([1]), but otherwise, nothing happens. 
After each step, time is augmented by the inverse of the 
system size t — * t + L^ 1 where L is the number of sites 
in the lattice. In our implementation, the front is al- 
ways located at the zeroth site, <Jo = 1. Whenever the 
front advances by n sites, all lattice sites are appropri- 
ately shifted to the left, ai — > <Ji- n (the n rightmost sites 
are reoccupied at random). Subsequently, the front po- 
sition is augmented by n. This efficient implementation 
allows us to simulate the evolution of the system up to 
extremely large times. We can evolve a system of size 
L = 10 2 up to time t = 10 11 , and we obtain statistical 
averages from snapshots of the system taken at unit time 
intervals. 



B. Front Propagation 

Whenever the leftmost site flips, the front position x 
advances by n lattice sites, 

• • • 0000 mil 0100 ► • • • 0000 00000 1011 • • • . (8) 

n n 

Hence, the leftmost string of occupied sites governs the 
front propagation. Like all other sites, the front flips at 
a unit rate, and consequently, the average front position 
grows ballistically, 

(x)~vt, (9) 

and the propagation velocity v equals the average size of 
the leftmost occupied string v = (n) . 

Let S n be the probability that the leftmost n lattice 
sites including the front are all occupied, 

S n = Prob(lllll). (10) 

n 

The probability of finding a string of exact length n as 
in {8]| is equal S n — S n +i, and therefore the velocity is 
given by v = (n) = J2^=i n (^n ~ S n +i)- Consequently, 
the velocity equals the sum of string probabilities 

oo 

V = J2 S n- (11) 

n=l 

In the Quasi-Static Approximation (QSA), correla- 
tions between different sites are neglected, and hence, 
the string probability (fTT)|) is a product over the corre- 
sponding densities, 

Sr°" =P1P2---Pn-1, (12) 

for n > 1 while Si = 1. With this approximate expres- 
sion, the propagation velocity is v = 1 + p± + P1P2 + 
P1P2P3 + • • • ■ We obtain the approximate velocity 

v QSA = 1.534070 (13) 

by substituting the densities from ((4]) into (fT2)) and then 
summing numerically. The velocity (|13p obeys the obvi- 
ous bounds 1 < v < 2. The lower bound reflects that 
the front must advance by at least one lattice site, and 
the upper bound corresponds to the completely random 
configuration, = 1/2 and S n = 2~( n ~ 1 \ 

The numerical simulations confirm that the front ad- 
vances ballistically (figure Ql but the propagation veloc- 
ity is larger than the value predicted by the quasi-static 
approximation 

v M c = 1-7624 ±0.0001. (14) 

Strong spatial correlations are primarily responsible for 
the discrepancy between (| 13[) and (|14p. Indeed, if we 
substitute the densities pk obtained from the Monte 
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FIG. 5: The string probability S n versus the string length n. 
The results are from a Monte Carlo simulation in a system of 
size L = 200, evolved up to time t — 10 11 . 

Carlo simulations into the product expression (fT2|) and 
perform the summation in (|11[) , we obtain the value 
v = 1.5329±0.0001 that is surprisingly close to the quasi- 
static approximation (|13[) . We therefore conclude that 
spatial correlations between neighboring sites have a sig- 
nificant effect on the velocity. 

C. Correlations, Aging, and Rejuvenation 

Spatial structures and spatial correlations can be quan- 
tified in multiple ways and we focus on the likelihood of 
occupied strings S n . Numerically, we find that this quan- 
tity decays exponentially (figure [5]), 

S n ~ n~ v \ n , (15) 

as n -> 00 with A = 0.745 ± 0.001 and v « 1. The 
quasi-static approximation yields much more rapid de- 
cay, A = 1/2 and v = 1 as follows from the algebraic tail 
© and the product expression (TT2"|) . Of course, when 
sites are completely uncorrelated, one also has A = 1/2. 
The fact that A is larger than 1/2 reflects that the sys- 
tem is strongly correlated. There is a significant enhance- 
ment of strings of consecutively occupied sites and this 
enhancement is largely responsible for the larger velocity 

Even though spatial correlations are significant and af- 
fect quantities of interest such as the velocity, they are 
limited in extent as indicated by the exponential decay 
of the string likelihood. For this reason, numerical sim- 
ulations may be performed in relatively small systems. 
Given the spatial extent of strings shown in figure [5l we 
performed the simulations using a relatively small sys- 
tem, L = 200. This system size is used throughout this 
investigation, unless noted otherwise. 

We also probed the correlation between two successive 
front "jumps" as a measure of temporal correlations. Let 
n and n' be the sizes of two consecutive jumps, respec- 
tively. If the front advances via a renewal process then 




(nnf) = (n) 2 = v 2 . However, the numerical simulations 
yield (nri) = 2.959 ±0.001 while v 2 = 3.1060 ± 0.0001. 
Thus, front advancement events are correlated, so the 
state of the system just after a jump is correlated with 
the state of the system just before a jump. 

This temporal correlation affects, in particular, the dif- 
fusion coefficient D that quantifies the uncertainty in the 
front position, 

(a; 2 ) - (x) 2 ~ 2Dt. (16) 

Numerically, we find D = 2.856 ±0.001. In contrast with 
the velocity (fTTj) that follows from average quantities such 
as the average segment density, the diffusion coefficient 
requires more detailed information about temporal cor- 
relations [Tlj |. 

To further characterize the dynamics, we define the age 
t as the time elapsed since the most recent front jump. 
Moreover, we define the age-dependent velocity u{r) as 
the average size of the leftmost string n as in © at age r 
because this quantity governs the front propagation. The 
simulations show that the velocity rapidly decays with 
age (figure [5]) . Of course, since long- living fronts outlive 
any of their occupied neighbors, u — > 1 as r — > oo. Ag- 
ing fronts are therefore sluggish. In contrast, newly-born 
fronts are much more vigorous because u(0) > v. Since 
the flipping process is completely random, the survival 
probability of a configuration decays exponentially with 
age. The average velocity in Ijllj) is the weighted integral 
of the age-dependent velocity 

/•OO 

V= dTu(T)e- T , (17) 

Jo 

and the weight equals the exponential survival probabil- 
ity. 

The age- dependence of the velocity implies that the 
shape of the front must also be age-dependent. We there- 
fore measured the density profile Cfc(r) = (tJfc(r)), defined 
as the average occupation at distance k from the front at 
age r. We find interesting evolution with age. The profile 



of long-living fronts has a depletion zone and is qualita- 
tively similar to the average profile discussed above, but 
the profile of newly born fronts has an enhancement of 
occupied sites over vacant sites (figure [7]). This rejuve- 
nation is intuitive: the state of the system just after a 
jump is a mirror image of the state of the system just be- 
fore the jump. Long living fronts are followed by a large 
string of vacant sites, and these fronts are necessarily 
slow. Yet, upon flipping, such sluggish fronts rejuvenate 
as the string of vacant sites become a string of occupied 
sites. Interestingly, the density profile may even be non- 
monotonic at intermediate ages. 

In conclusion, the flipping process involves all the hall- 
marks of nonequilibrium dynamics including spatial cor- 
relations, temporal correlations, aging, and rejuvenation 
0- 



D. Small Segments 

We complete the analysis with a direct solution for the 
state of small segments containing the front. The k left- 
most sites can be in any one of 2 fc_1 possible configura- 
tions. The equations describing the configuration proba- 
bilities are hierarchical: due to the front motion, the state 
of small segments containing the front is coupled with the 
state of larger segments. To overcome this closure issue, 
we propose an approximation where the state of the sys- 
tem outside the segment of interest is completely random, 
as in our simulation method. Clearly, this approximation 
becomes exact as k — > oo. 

A segment of length two can be in one of two config- 
urations: 10 or 11. The respective probabilities Pio and 
P\x evolve according to 

^ = -P w + Pn + \ Pn + \ Pio (18a) 
d -^ = -2P ll + \p ll + \ Pw . (18b) 
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1.687108 
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1.763533 
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1.705987 


1.764330 


1.762272 


1.761669 
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1.720251 


1.763754 


1.761864 
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1.730993 


1.763313 








11 


1.739055 











TABLE I: The velocity v, obtained by successive iterations of 
the Shanks transformation (propagating fronts). 



quantity 


propagating fronts 


pinned fronts 


V 


1.7624 


1.7753 


D 


2.856 


3.178 


A 


0.74 


0.75 


Pi 


0.3492 


1/3 


P2 


0.3400 


1/3 


P3 


0.3479 


41/120 



TABLE II: The velocity v, the diffusion coefficient D, the 
decay constant governing the string probability A, and the 
first few densities pk for propagating and pinned fronts. The 
results are from Monte Carlo simulations in a system of size 
L — 200 evolved up to time t = 10 11 . The exact solution for 
the density profile is detailed below. 



We explain the latter equation in detail. The loss rate in 
(|18bp equals two because any of the two occupied sites 
may flip. If the front flips, there is advancement, and 
since the second site is occupied with probability 1/2, the 
gain terms are \P\\ and \ Plo- The steady state solution 
is (Pio,Pu) = |(1,3); therefore pi = 1/4. We denote by 
Vk the velocity obtained from a segment of length k. For 
k = 2 we have V2 = Pio + 3Pn since the front advances 
by one site when the front flips in the state 10, but it 
advances three sites in the state 11 (two sites plus an 
average of one, given the random occupation outside the 
segment). 

For k = 3, the governing equations are 



dPioo 
dt 


— —Pioo + 


fiVn + 


\ p ™ + 




(19a) 


dP W i 
dt 


_ 3 

- -^ioi 


+ jPn. 


+ \Pm 




(19b) 


dPuo 
dt 


_lp 


4P110 + 


\ PlU 




(19c) 


dP ul 
dt 


1 

= 2^100 + 


1 

I P11 ° - 


11 

T Pn, 




(19d) 



The steady state solution is (Piocb PloIi Plioj Plii) = 
^(27,11,12,6); thus, the densities are p\ = 9/28, and 
p 2 = 17/56 and the velocity is v 3 = 43/28. Further- 
more, V4 = 10907/6872 and the approximation steadily 
improves as k increases. 

We can compute the configuration of segments with 
k < 12 as detailed in Appendix A. To extrapolate the 
velocity, we use the Shanks transformation [1 31 ] 



„(m+l) 
k 



V 



(m) (m) 



V 



(m) (m) 



(m) 
,J k-l 



(m) 
' ] k+l 



2v 



(m) 



(20) 



where Vn is the velocity estimate after m iterations. 
Repeated Shanks transformations give a useful estimate 
for the propagation velocity (see Tabic II), 



Vshanks = 1.76 ±0.01. 



(21) 



The Shanks transformation can be used to estimate 
other quantities as well. For example, we obtain 



an excellent estimate for the density of the first site, 
pi = 0.3492 ±0.0001. 

III. PINNED FRONTS 

As discussed above, the quasi-static approximation ne- 
glects the movement of the front and possible correlations 
between sites. Of these two assumptions, the latter is 
more significant. We therefore modify the original flip- 
ping process and forbid the front from changing state. 
This minor modification pins the front and allows us to 
focus on the role of correlations. 

In the pinned process, a flip event at every site other 
than the origin changes the state of the system exactly 
as in |T]), but a flip event at the origin yields 



1 — ai, for all i > 0. 



(22) 



Hence, the site at the origin is always occupied, ao(t) = 1. 

Remarkably, pinning the front results in only minor 
quantitative changes. All quantities of interest including 
the velocity v, the diffusion coefficient D, the decay con- 
stant underlying the decay of the segment density A, and 
the density profile pk are all within a few percent of the 
corresponding values for propagating fronts (Table II) . In 
particular, the discrepancy in the propagation velocity is 
smaller than 1%, 



Wpinncd = 1.7753 ±0.0001. 



(23) 



We note that the velocity and the diffusion coefficient are 
obtained by using the running total of segment lengths 
at the time when the origin causes a flip as a surrogate 
for the front position x. Finally, we can not exclude the 
possibility that the string probability S n is characterized 
by the same parameter A in both processes (Table II). 

In addition, pinned fronts and propagating fronts have 
very similar density profiles (figure [5]) • The quasi-static 
approximation, which is better suited for pinned fronts, 
becomes slightly more accurate. Of course, the exact tail 
behavior ^ and the logarithmic excess ([7]) extend to 
pinned fronts. 
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FIG. 8: The density pk versus distance k for pinned and prop- 
agating fronts. Both profiles are obtained using Monte Carlo 
simulations. 



A. Correlations 

The hierarchical evolution equation ^ for the aver- 
age occupation only assumes that the front is pinned 
and hence, this equation provides an exact description. 
Therefore, the single-site averages and the two-site aver- 
ages are related, 



fc-i fc-i 
3=0 j=0 



(24) 



at the steady state. Of course, (cro) = 1. 

We can obtain the nearest-neighbor correlation 
(<Tfc(7fc+i), a quantity that evolves according to 



d(<J k O k +\ 

dt 



fc-i 



2 + 5>; | <J k <J k+ i ) (25) 
j=o 



'fc-i 



+((1 - a k )<r k+1 ) + MS^'I ■ 

This equation is very similar to the equation governing 
the one-site correlation. The rate of change for two oc- 
cupied sites is 2 + Y2j=o u i because either one of the two 
sites can flip. In general, the equation for two-site corre- 
lations involves three-site correlations, but in the partic- 
ular case of neighboring sites, the three-site correlation 
cancels in (|2"5)) ! We therefore obtain a relation between 
average densities and two-site correlations 

fe-2 fc-2 fc-i 

53<°j> = (o-fc-icrfc) + ^2{aj(T k -i) + ^(o-jfffe). (26) 

3=0 3=0 3=0 

There are two different relations between the average 
density and the two-site correlation: equations (f2~4"|) and 



h 
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Pk 


>5fe+l 


t>k+l 


n 
u 


1 
1 


1 
1 


1 
1 
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1 


1 


4 
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3 


3 


2 


1 


1 


3 




3 


6 


2 


3 


41 


23 


383 




120 


240 


240 


4 


76121 


25577 


714977 




216000 


432000 


432000 



TABLE III: The density pt, the string density Sk, and the 
velocity v k = Yl n =i obtained by direct solution of the 
microscopic evolution equations. 



By manipulating the two, we obtain the nearest- 
neighbor correlation in terms of the average density, 



(cTfeCfc+l) = - ((Tfc+l) 



(27) 



for k > 0. This relation demonstrates that neighboring 
sites are positively correlated, 



(ofcOfc+i) - Wk)Wk+i) = [ 2 - ) Wk+i)- i- s ! 



We also note that correlations decay slowly at 
large distances as equations ([6]) and ([28)1 imply 
<CTfcCTfc+l) - (<T k )(a k+1 ) ~ (4k)- 1 . 

For completeness, we mention that the correlation be- 
tween three consecutive sites can also be written as a 
function of lower-order correlations 

{(J k a k+1 a k+2 ) = ^(crfc+ 2 (l - o-fe)>. (29) 



B. Small Systems 

When the front is pinned, the system reaches a sta- 
tionary state. This steady state can be obtained exactly 
for small system by considering the evolution of all possi- 
ble configurations. For pinned fronts, finite segments are 
not affected by flipping outside the segment, and conse- 
quently, the evolution equations are now closed. 

Consider for example a system with two sites. There 
are two possible configurations: 10 and 11 with the re- 
spective probabilities Pn and Pio. These probabilities 
evolve according to 



dPi 



in 



dt 
dPn 
dt 



= -P w + 2P U 
= -2P n + P 10 . 



(30a) 
(30b) 

|(2, 1) and con- 



Hence, at the steady state, (-Pio,-Pii) 
sequently, p\ = S2 = 1/3. 

Next we consider the first three sites with the four con- 
figurations 100, 101, 110, 111. The evolution equations 



k 


(0) 




(2) 


(3) 


(4) 
V k 


1 


1. 










2 


1.333333 


1.666666 








3 


1.5 


1.72549 


1.769737 






4 


1.595833 


1.750742 


1.773156 


1.775020 




5 


1.655039 


1.762616 


1.774362 


1.775178 


1.775278 


6 


1.693228 


1.768521 


1.774849 


1.775239 


1.775289 


7 


1.718565 


1.771576 


1.775065 


1.775267 


1.775293 


8 


1.735709 


1.773205 


1.775170 


1.775280 


1.775293 


9 


1.747473 


1.774095 


1.775223 


1.775287 




10 


1.755632 


1.774593 


1.775252 






11 


1.761337 


1.774876 








12 


1.765350 











TABLE IV: Iterated Shanks transformations for the velocity. 
The zeroth column is from the small system solution (pinned 
fronts) . 



for the respective probabilities are 

dPwa 

dt 
dP W i 

dt 
dPiw 

dt 
dPm 

dt 

The steady state solution is (Piooj Ptoi! PiiOi Pill) = 
1(3,1,1,1). Therefore ,01=^2 = 1/3 and S 3 = 1/6. 



P100 "+ 


"110 + + -Pi 01 


(31a) 


2P101 


+ 2Piio 


(31b) 


2P11Q 


+ P101 + P111 


(31c) 


3P m 


+ P100 ■ 


(31d) 



Results for k < 4 are summarized in tabic IIIII 

In general, there are 2 k ~ 1 microscopic configurations 
in a system of size k. We can compute the stationary 
probabilities for systems of size k < 12 as detailed in 
Appendix B. Knowledge of these steady state probabili- 
ties yields the density pk, the string probability Sk, and 
hence, an estimate for the velocity Vk — 2n=i ^n< 

The velocity, as well as other quantities of interest, 
can be obtained very accurately using the Shanks trans- 
formation. We find fshanks = 1-7753 ± 0.0001, in per- 
fect agreement with the Monte Carlo simulations |23|) as 
shown in Table HVl 



C. Aging and Rejuvenation 

We also examined the evolution with age and found 
that pinned and propagating fronts display very simi- 
lar behaviors, as evident from the age-dependent density 
c fe (r) (figure©. 

For pinned fronts, the zero age configuration is the 
exact mirror image of the configuration just before the 
flip and since the front flips at random, 




FIG. 9: The density Ck at different ages for pinned fronts 
(broken lines) and propagating fronts (solid lines). 



for all sites except the origin, k > 0. This expres- 
sion demonstrates the enhancement of occupied sites for 
newly born configurations. 

Aging can be conveniently studied using small sys- 
tems. For the first site, we have dci/dr = —c\ and 
therefore, c±(t) — ci(0)e~ T . The initial condition, 
Cl (0) = 1 - pi = 2/3 follows from (J32J). Therefore, 



ci(r) = -e~ T . 



(33) 



For the first two sites, there are four configurations: 
100, 101, 110, 111, and the respective probabilities evolve 
according to 



dPi 



1(H) 



dr 
dP 10 i 

dr 
dP no 

dr 
dPm 

dr 



= Pin + P101 
= — P101 + Pi 10 
= — Plio + P111 

= -2P111. 



(34a) 
(34b) 
(34c) 
(34d) 



These equations differ from (|3 1 [) in that flipping 
events caused by the front are excluded. The 
initial condition again mirrors the stationary state 
(Poo, P01, P110, Pm)| T=0 = 1(1, 1, 1, 3). By solving the 
evolution equations, the age-dependent density of the sec- 
ond site, c 2 = P101 + Pin, is 



c 2 (r) = i(2r-l) e - r + e- 



(35) 



Cfc(r = 0) = 1 - pk 



(32) 



Already, we can justify the non-monotonic behavior seen 
in figures and ©: c x > c 2 for t < with t* = 0.8742 
while ci < c 2 for otherwise. In general, all densities 
exhibit a simple exponential decay with age, Cfe(r) oc e~ T 
as t — > 00. We conclude that pinned fronts faithfully 
capture aging and rejuvenation. 
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IV. CONCLUSIONS 

In conclusion, we reformulated the bit flipping pro- 
cess underlying the simplex algorithm as a nonequilib- 
rium dynamics problem and studied spatial and tempo- 
ral properties using theoretical and computational meth- 
ods. Overall, we find that the infinite interaction range 
leads to rich phenomenology. There is a front that prop- 
agates ballistically with a nontrivial velocity that is gov- 
erned by the length of the occupied strings containing 
the front. The propagating front includes a deep deple- 
tion zone: vacant sites outnumber occupied sites with 
the total excess of unoccupied sites growing logarithmi- 
cally with depth. The flipping process is characterized 
by significant spatial correlations. For example, the like- 
lihood of finding strings of consecutively occupied sites 
is strongly enhanced. 

The flipping process also exhibits nontrivial dynamics. 
Successive front jumps are correlated and additionally, 
there are aging and rejuvenation as young fronts are fast 
but old fronts are slow. Underlying this behavior is the 
fact that the state of the system just after a jump mirrors 
the state of the system just before a jump. 

We slightly modified the original flipping process by 
pinning the front. Qualitatively and quantitatively, 
pinned fronts and propagating fronts are very close. We 
demonstrated analytically much of the interesting phe- 
nomenology including spatial correlations, aging, and re- 
juvenation for pinned fronts. 

Aging is usually characterized by using two different 
times [14j . Here, in contrast, the time elapsed since the 
latest front yields a natural definition of age and a charac- 
terization of the dynamics that complements time itself. 



We comment that there is an alternative way of study- 
ing the density profile throu gh a n average at a given lat- 
tice site over all realizations [15j |. The corresponding av- 
erage density Pk(t) reaches a stationary form once the 
average and the variance are taken into account, 

— ( w) < 36) 

with <&(— oo) = and $(00) = 1/2. This approach has 
a disadvantage: the scaling function $(2;) is dominated 
by fluctuations in the position of the front. In other 
words, the density profile pk is smeared because of dif- 
fusion. These less interesting diffusive fluctuations are 
suppressed when the front profile is probed in a reference 
frame moving with the front. 

We also presented a systematic solution method of 
small systems and successfully demonstrated how to ex- 
trapolate relevant parameters for infinite systems. Yet, 
since the complexity grows exponentially with system 
size, such computations quickly become prohibitive. We 
have also seen how most quantities of interest require an 
infinite hierarchy of equations. Finding an appropriate 
theoretical framework with closed evolution equations re- 
mains a formidable challenge. Nevertheless, the pinned 
front process provides a powerful theoretical framework. 
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APPENDIX A: TRANSITION MATRIX FOR 
PROPAGATING FRONTS 

The evolution equations for the configuration proba- 
bilities in a finite segment of size k can be represented in 
the matrix form 

dP 

— =MP. (Al) 
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Here, P is the vector P = {Py |0 < j < U - 1} 
where j, written as a binary, is in increasing order and 
U = 2 k ~ 1 . For example, when k = 5 the state vector 
is (-PiqooO)-PiqooI)- ' ' ,-Piim), with U = 16 entries. The 
elements of this vector equal the probabilities that the 
system is in the respective configuration. Also, M is the 
U x U transition matrix whose elements equal the tran- 
sition rates between the corresponding configurations. 
The transition matrix JVC is a sum of three matrices 



each column of M sums to zero. We note that the 
transition matrix is sparse. The steady state proba- 
bility equals the zeroth eigenvector, MP = 0. Fi- 
nally, the velocity follows from the average advance- 
ment expected in each configuration. This advance- 
ment is represented by the vector J and for example, 
J = (1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 3, 3, 4, 6) for k = 5. The 
velocity is simply the scalar product, v = J • P. 



M = Mi + M 2 - 
We quote the first two for k = 5, 

1 



M, 



/ 1 1 
1 



Mi 



1 



1 1 
1 

1 



1 1 



and 



M 2 



1 

16 



(A2) 



l\ 



1 
1 

0/ 









4 




2 


1 


l\ 








4 




2 


1 


1 








4 




2 


1 


1 








4 




2 


1 


1 






4 






2 


1 


1 






4 






2 


1 


1 






4 






2 


1 


1 






4 






2 


1 


1 




4 






2 




1 


1 




4 






2 




1 


1 




4 






2 




1 


1 




4 






2 




1 


1 


4 








2 




1 


1 


4 








2 




1 


1 


4 








2 




1 


1 


4 








2 




1 


1/ 
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The third matrix M3 is diagonal and it guarantees that 



APPENDIX B: TRANSITION MATRIX FOR 
PINNED FRONTS 



Using the matrix notation in ()A1 1) , the evolution equa- 
tions for k = 4 involve the following transition matrix 



(-1 1 



M = 



2\ 



-2 1 



-2 1 



-3 2 



1 -2 1 



3 1 



V 1 



-3 1 
-4/ 



In this case, the steady state probabilities are 



/ P1000 \ 
Pi 001 
P1010 
P1011 
Pi 100 
P1101 
P1110 

V Pun J 



1 

240 



/92\ 

28 

22 

18 

27 

13 

17 
\23/ 



(Bl) 



(B2) 



Thus, the density is P3 = 41/120 and the string proba- 
bility is Pi = 23/240. 



